Search AI Products and News

AMD's advancements in AI are noteworthy, particularly its latest optimizations for the Stable Diffusion model. Recently, Stability AI released an ONNX-optimized version of Stable Diffusion, resulting in significantly improved performance for AMD Radeon GPUs and Ryzen integrated graphics in AI tasks, with speed increases up to 3.8 times faster. This progress narrows the gap with NVIDIA's ecosystem...

Pruna AI, a European startup focused on AI model compression algorithms, recently announced the open-sourcing of its optimization framework to help developers more efficiently compress AI models. The framework developed by Pruna AI combines several efficiency methods, including caching, pruning, quantization, and distillation, aiming to improve AI model performance. It not only standardizes the saving and loading of compressed models but also evaluates the compressed models to determine whether their quality has significantly degraded, while simultaneously measuring performance.

DeepSeek launched an official account on Zhihu and published a technical article, "DeepSeek-V3/R1 Inference System Overview," detailing its model inference system optimization and cost-profit margin information for the first time, marking the end of the highly anticipated DeepSeek Open Source Week. The article highlights two key optimization goals for the DeepSeek-V3/R1 inference system: higher throughput and lower latency. To achieve these goals, DeepSeek employs large-scale cross-node expert parallelism (EP) technology, although...